Information processing device, information processing method, and computer program product

ABSTRACT

According to an embodiment, an information processing device includes a receiving unit, a detection unit, a generation unit, and an output unit. The receiving unit is configured to receive an original image. The detection unit is configured to detect a write region in which additional information is to be written, from the original image. The generation unit is configured to generate a position specifying image for specifying a position of the write region in the original image, the position specifying image being to be added to a predetermined region in the original image. The output unit is configured to output the position specifying image.

CROSS-REFERENCE TO RELATED APPLICATION

This application is, a continuation of PCT international applicationSer. No. PCT/JP2012/073360 filed on Sep. 12, 2012 which designates theUnited States, the entire contents of which are incorporated herein byreference.

FIELD

Embodiments described herein relate generally to an informationprocessing device, an information processing method, and a computerprogram product.

BACKGROUND

A technology of writing additional information in an optically-readableformat such as characters or symbols, bar codes, and two-dimensionalcodes in an input document or the like using a visible or invisible inkhas been widely used in, for example, the field of a ledger sheetprocess. In the field of the ledger sheet process, a process number andthe like are written as the additional information in the ledger sheetwith entries already written therein, and the process number and thelike written in the ledger sheet are optically read to be utilized forthe subsequent processes.

For the correctness in reading, the additional information makes it arule to be written at a position where no overlapping with otherpre-existing entries occurs. However, when the format of a document orthe like is unknown, the additional information may be written on thepre-existing entries so as to be overlapped with each other, and thusthe additional information may not be correctly read. In addition, whena wide variety of document formats are handled, a region enough to writethe additional information may not be acquired in the same position withrespect to the whole formats in common. For this reason, there has beena demand for a technology through which a write region of the additionalinformation can be appropriately acquired with respect to the documentsof an unknown format and a wide variety of formats, and the additionalinformation written in the region can be correctly recognized.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram schematically illustrating a configuration of a formprocessing system;

FIG. 2 is a block diagram illustrating the functional configuration of afirst information processing device;

FIG. 3 is a schematic diagram conceptually illustrating an exemplaryprocess in which a detection unit detects a write region from anoriginal image;

FIG. 4 is a diagram illustrating an example of a position specifyingimage which is generated by a generation unit;

FIG. 5 is a flowchart illustrating the sequence of a series of processeswhich are performed by the first information processing device;

FIG. 6 is a block diagram illustrating the functional configuration of asecond information processing device;

FIG. 7 is a schematic diagram conceptually illustrating an exemplaryprocess in which a specification unit detects a write region from aprocessed image;

FIG. 8 is a flowchart illustrating the sequence of a series of processeswhich are performed by the second information processing device;

FIG. 9 is a diagram illustrating a position specifying image of a firstmodification;

FIG. 10 is a diagram illustrating a position specifying image of asecond modification;

FIG. 11 is a diagram illustrating a position specifying image of a thirdmodification;

FIG. 12 is a diagram illustrating a position specifying image of afourth modification;

FIG. 13 is a diagram illustrating a position specifying image of a fifthmodification;

FIG. 14 is a diagram illustrating a position specifying image of a sixthmodification;

FIG. 15 is a diagram illustrating a position specifying image of aseventh modification; and

FIG. 16 is a diagram illustrating an example of hardware configurationsof the first information processing device and the second informationprocessing device.

DETAILED DESCRIPTION

According to an embodiment, an information processing device includes areceiving unit, a detection unit, a generation unit, and an output unit.The receiving unit is configured to receive an original image. Thedetection unit is configured to detect a write region in whichadditional information is to be written, from the original image. Thegeneration unit is configured to generate a position specifying imagefor specifying a position of the write region in the original image, theposition specifying image being to be added to a predetermined region inthe original image. The output unit is configured to output the positionspecifying image.

Hereinafter, embodiments of an information processing device, aninformation processing method, and a program will be described withreference to the drawings. The embodiments to be described below areexamples of the application to a form processing system which is usefulfor various processes in which process numbers as additional informationare written in ledger sheets with entries already written therein andthen the process numbers are read to identify the ledger sheets.However, the applicable system is not limited to the above system.

Form Processing System

FIG. 1 is a diagram schematically illustrating a configuration of a formprocessing system according to an embodiment. The form processing systemaccording to the embodiment is provided with a first informationprocessing device 10, a second information processing device 20, aprocess number assigning device 30, and a printing device 40.

The first information processing device 10 receives an original imageIm1, detects a write region to which the process number is written asthe additional information from the original image Im1, generates aposition specifying image Im2 which is an image which is added to apredetermined region (for example, a predetermined width of region onthe peripheral of the image) of the original image Im1, and used tospecify a position of the write region in the original image Im1, andoutputs the position specifying image Im2. Hereinafter, thepredetermined region serving as a region to be added with the positionspecifying image Im2 will be referred to as an image addition region.

The original image Im1 which is input to the first informationprocessing device 10 is image data which is obtained through a scanner(not illustrated) or the like by optically reading a ledger sheet LS1with entries already written therein. The original image Im1 may bedirectly input to the first information processing device 10 through thescanner or the like, or may be stored once in a predetermined storagedevice and then input to the first information processing device 10 fromthe storage device. In addition, the original image Im1 may be input tothe first information processing device 10 via a network from anexternal device which is connected to the first information processingdevice 10 through the network.

The position specifying image Im2 which is output by the firstinformation processing device 10 is input to the process numberassigning device 30. In addition, the first information processingdevice 10 sends the coordinate values of a representative point (forexample, the center point of the write region) of the write region inthe original image Im1 to the process number assigning device 30 besidesthe position specifying image Im2. The process number assigning device30 specifies the position of the write region based on the coordinatevalues, and superimpose an image written with the process numbercorresponding to the ledger sheet LS1 onto the position specifying imageIm2 at the position of the write region, so that a print target imageIm3 is generated. Then, the print target image Im3 is output. The printtarget image Im3 output from the process number assigning device 30 isinput to the printing device 40.

Further, the print target image Im3 may be generated as follows: theposition specifying image Im2 output from the first informationprocessing device 10 is directly input to the printing device 40; theprocess number assigning device 30 inputs the image in which the processnumber is written at the position of the write region to the printingdevice 40; then, these images are superimposed in the printing device40.

Besides the input of the print target image Im3, the printing device 40is supplied with the ledger sheet LS1 (a print medium) corresponding tothe original image Im1. The printing device 40 prints the print targetimage Im3 input from the process number assigning device 30 on theledger sheet LS1 to be superimposed to each other. With thisconfiguration, the position specifying image Im2 is printed in theregion on the ledger sheet LS1 corresponding to the image additionregion of the original image Im1, the printing device 40 discharges aledger sheet LS2 on which the process number is printed at the positionon the ledger sheet LS1 corresponding to the write region of theoriginal image Im1.

The second information processing device 20 receives a processed imageIm4, based on the position specifying image Im2 included in theprocessed image Im4, specifies a position of the write region in theprocessed image Im4, and recognizes and outputs the process numberwritten in the write region. The process number output from the secondinformation processing device 20 is utilized in a ledger sheet processwhich is performed since then.

The processed image Im4 input to the second information processingdevice 20 is image data which is obtained through a scanner (notillustrated) or the like by optically reading the ledger sheet LS2 whichis discharged from the printing device 40, and includes the printedposition specifying image Im2 and the printed process number. In otherwords, the processed image Im4 is an image formed as follows: theposition specifying image Im2 output from the first informationprocessing device 10 is added to the image addition region of theoriginal image Im1, and the process number is written by the processnumber assigning device 30 in the write region detected by the firstinformation processing device 10. Similarly to the original image Im1,the processed image Im4 may be directly input to the second informationprocessing device 20 through a scanner or the like. Alternatively, afterbeing stored in a predetermined storage device once, the processed imagemay be input from the storage device to the second informationprocessing device 20. In addition, the processed image Im4 may be inputfrom the external device, which is connected to the second informationprocessing device 20 through the network, to the second informationprocessing device 20 through the network.

First Information Processing Device

Next, the first information processing device 10 will be described indetail. FIG. 2 is a block diagram illustrating a functionalconfiguration of the first information processing device 10. The firstinformation processing device 10 includes a receiving unit 11, adetection unit 12, a generation unit 13, an output unit 14 as functionalcomponents as illustrated in FIG. 2.

The receiving unit 11 receives the original image Im1. The originalimage Im1, as needed, is subjected to pre-processes, for example, abinarization, a tilt correction process, and the like for a color image.Then, the pre-processed image is sent to the detection unit 12.

The detection unit 12 detects the write region to be written by theprocess number from a region except the image addition region in theoriginal image Im1. In the embodiment, it is assumed that a regionhaving a predetermined width (a width small enough to be considered asno entries therein) in the peripheral of the original image Im1 is setin advance as the image addition region.

FIG. 3 is a schematic diagram conceptually illustrating an exemplaryprocess in which the detection unit 12 detects the write region from theoriginal image Im1. For example, as illustrated in FIG. 3, the detectionunit 12 scans a region in the original image Im1 except the imageaddition region Rs; obtains parameters x and y which make an evaluationfunction represented by the following Equation (1) minimized and setsthe parameters as x0 and y0; and detects a rectangular region of 2w(height)×2h (width) around the pixel (x0, y0), as a write region Rn.

$\begin{matrix}{{{F\left( {x,y} \right)} = {\sum\limits_{\underset{{y - h} \leq q < {y + h}}{{x - w} \leq p < {x + w}}}{f\left( {p,q} \right)}}}{{{where}\mspace{14mu} w} \leq x < {W - {w\mspace{14mu} {and}\mspace{14mu} h}} \leq y < {H - {h.}}}} & (1)\end{matrix}$

Herein, the values of the parameters x and y are constrained such thatthe rectangular region is not overlapped with the image addition regionRs. In addition, it is assumed that the size of the write region Rn isconstant and the values of the parameters w and h are set in advance tofix the size of the rectangular region. Further, the size of the writeregion Rn, for example, may be set to a variable size which isdesignated by the process number assigning device 30 or the like. Inthis case, the values of the parameters w and h which determine the sizeof the rectangular region are determined depending on the size of thedesignated write region Rn.

In addition, it is assumed that the original image Im1 is a W (width)×H(height) rectangular image which has been quantized, and f(x, y)represents a pixel value at a position (x, y) which is standardized tobe maximized in a foreground color (in which the entries are present)and to be minimized in a background color (in which no entries arepresent). In this case, the least region which is overlapped with thepre-existing entries is detected as the write region Rn in the originalimage Im1.

Returning to FIG. 2, the generation unit 13 generates the positionspecifying image Im2 which is an optically-readable image for specifyingthe position of the write region detected by the detection unit 12.Various shapes of the position specifying image Im2 may be considered.Herein, as an example, the position specifying image Im2 is generatedsuch that the position of the image addition region overlapped with thewrite region detected by the detection unit 12 in the horizontal orvertical direction of the original image Im1 is distinguished from thepositions of the other image addition regions on the assumption that aregion having a predetermined width in the peripheral of the originalimage Im1 is determined in advance as the image addition region.

FIG. 4 is a diagram illustrating an example of the position specifyingimage Im2 which is generated by the generation unit 13. The positionspecifying image Im2 illustrated in FIG. 4 is an image which includes,for example, black markings at the positions of the image additionregion Rs with which projections of the write region Rn detected by thedetection unit 12 are intersected with in the horizontal and verticaldirections. In the position specifying image Im2 illustrated in FIG. 4,the position of the write region Rn detected by the detection unit 12can be specified based on the marking position of the regioncorresponding to a first side of the original image Im1 and the markingposition of the region corresponding to a second side intersected withthe first side of the original image Im1 in the image addition regionRs.

Further, in the position specifying image Im2 illustrated in FIG. 4, theposition of the write region Rn can be specified based on two markingpositions corresponding to two intersecting sides of the original imageIm1. However, as illustrated in FIG. 4, four marking positionscorresponding to four sides of the original image Im1 are illustrated inorder to obtain redundant pieces of information for specifying theposition of the write region Rn. Therefore, for example, even when one(or two) of the four markings is difficult to be appropriately read dueto the overlapping with a pre-existing entry, the position of the writeregion Rn may be correctly specified based on the positions of the othermarkings.

Returning to FIG. 2, the output unit 14 converts the position specifyingimage Im2 generated by the generation unit 13 into an image in a format,as needed, which can be handled by the process number assigning device30, and outputs the resultant image to the process number assigningdevice 30. Further, as described above, the output unit 14 also outputscoordinate values of the representative point of the write region in theoriginal image Im1 to the process number assigning device 30independently from the position specifying image Im2.

FIG. 5 is a flowchart illustrating the sequence of a series of processeswhich are performed by the first information processing device 10. Whenthe first information processing device 10 is activated, the receivingunit 11 first receives the original image Im1 (step S101). Next, thedetection unit 12 detects the write region from the original image Im1received in step S101 (step S102). Next, the generation unit 13generates the position specifying image Im2 which is used for specifyingthe position of the write region detected in step S102 (step S103).Finally, the output unit 14 outputs the position specifying image Im2generated in step S103 to the process number assigning device 30 (stepS104).

Second Information Processing Device

Next, the second information processing device 20 will be described inmore detail. FIG. 6 is a block diagram illustrating the functionalconfiguration of the second information processing device 20. The secondinformation processing device 20, as illustrated in FIG. 6, includes areceiving unit 21, a specification unit 22, a recognition unit 23, andan output unit 24 as functional components.

The receiving unit 21 receives the processed image Im4. The processedimage Im4, as needed, is subjected to pre-processes, for example, abinarization, a tilt correction process, and the like for a color image.Then, the pre-processed image is sent to the specification unit 22.

The specification unit 22 specifies the position of the write region inthe processed image Im4 based on the position specifying image Im2included in the processed image Im4.

FIG. 7 is a schematic diagram conceptually illustrating an exemplaryprocess in which the specification unit 22 detects the write region Rnfrom the processed image Im4. Herein, as described above, the positionspecifying image Im2 is assumed as an image which includes, for example,black markings at the positions of the image addition region Rs withwhich projections of the write region Rn are intersected in thehorizontal and vertical directions.

In this case, as illustrated in FIG. 7, the specification unit 22performs the following processes for every horizontal line whichincludes the pixels aligned in the horizontal direction in a region Rs1which extends in the vertical direction in the image addition region Rs:obtaining a ratio occupied by the pixels of the foreground color (forexample, black) in the pixels constituting the region Rs1; and setting aposition of which the ratio occupied by the pixels of the foregroundcolor exceeds a predetermined threshold value as the marking position.Then, the specification unit 22 specifies two horizontal lines (a firstboundary horizontal line HL1 and a second boundary horizontal line HL2)which are boundaries between the marking position and no markingpositions. The specification unit 22 further performs the followingprocesses for every vertical line which includes the pixels aligned inthe vertical direction in the region Rs2 which extends in the horizontaldirection in the image addition region Rs: obtaining a ratio occupied bythe pixels of the foreground color (for example, black) in the pixelsconstituting the region Rs2; and setting a position of which the ratiooccupied by the pixels of the foreground color exceeds a predeterminedthreshold value as the marking position. Then, the specification unit 22specifies two vertical lines (a first boundary vertical line VL1 and asecond boundary vertical line VL2) which are boundaries between themarking position and no marking positions. Then, the specification unit22 specifies the write region Rn based on a region surrounded by fourline segments: the first boundary horizontal line HL1; the secondboundary horizontal line HL2; the first boundary vertical line VL1; andthe second boundary vertical line VL2.

As described above, the specification unit 22 compares the ratiooccupied by the pixels of the foreground color with the threshold valueto specify the marking position. Therefore, for example, even when apart of the marking portion is reversed in color (for example, white) tothat of the background color due to a print failure, a read failure, orthe like, it is possible to correctly recognize the marking position andthus to exactly specify the write region Rn.

Returning to FIG. 6, the recognition unit 23 recognizes the processnumber written in the write region which is specified by thespecification unit 22, that is, the process number which is written asthe additional information in the write region of the ledger sheet LS1by the process number assigning device 30, using a known technology suchas character recognition.

The output unit 24 outputs the process number which is recognized by therecognition unit 23.

FIG. 8 is a flowchart illustrating the sequence of a series of processeswhich are performed by the second information processing device 20. Whenthe second information processing device 20 is activated, the receivingunit 21 first receives the processed image Im4 (step S201). Next, thespecification unit 22 specifies the position of the write region in theprocessed image Im4 based on the position specifying image Im2 includedin the processed image Im4 received in step S201 (step S202). Next, therecognition unit 23 recognizes the process number which is written inthe write region recognized in step S202 (step S203). Finally, theoutput unit 24 outputs the process number recognized in step S203 (stepS204).

Hitherto, as described above in detail while giving a specific example,the first information processing device 10 of the form processing systemaccording to the embodiment receives the original image Im1 which isobtained by optically reading the ledger sheet LS1, detecting the writeregion which is used to write the process number (the additionalinformation) from the original image Im1, generating the positionspecifying image Im2 which is used to specify the position of the writeregion, and outputting the position specifying image Im2. In addition,the second information processing device 20 receives the processed imageIm4 obtained by optically reading the ledger sheet LS2 which includesthe process number printed in the write region of the ledger sheet LS1and the position specifying image Im2 printed in the image additionregion, specifying the position of the write region based on theposition specifying image Im2 included the processed image Im4, andrecognizing the process number written in the write region. Therefore,even when the ledger sheet is unknown or various in templates, the formprocessing system can appropriately obtain the region where the processnumber (the additional information to the ledger sheet) is written, andcorrectly recognize the additional information which is written in theregion.

Further, in the above-mentioned embodiment, the description has beenmade in connection with an aspect of the position specifying image Im2.However, other variations other than the above-mentioned example can beconsidered as the aspect of the position specifying image Im2.Hereinbelow, other aspects of the position specifying image Im2 will bedescribed as modifications.

First Modification

FIG. 9 is a diagram illustrating a position specifying image Im2 a of afirst modification. In the first modification, the description will bemade on the assumption that a small part of the peripheral region of theoriginal image Im1 is set at the image addition region Rs in advance. Inthe image addition region Rs, the generation unit 13 of the firstinformation processing device 10 generates an image with a bar code asthe position specifying image Im2 a, in which the bar code is disposedto represent the coordinate values of the representative point (forexample, the center point Pc) of the write region Rn detected by thedetection unit 12.

In a case of the first modification, the specification unit 22 of thesecond information processing device 20 reads the bar code of theposition specifying image Im2 a included in the processed image Im4.Therefore, the position of the write region Rn in the processed imageIm4 can be specified.

Further, the position specifying image Im2 a of the first modificationmay dispose, instead of the bar code, a two-dimensional coderepresenting the coordinate values of the representative point of thewrite region Rn or a numeral value representing the coordinate values inthe image addition region Rs. In addition, the position specifying imageIm2 a of the first modification may dispose not only the coordinatevalues of the representative point of the write region Rn, but also thebar code including other pieces of information such as the size of thewrite region Rn, the two-dimensional code, and the numeral value in theimage addition region Rs.

Second Modification

FIG. 10 is a diagram illustrating a position specifying image Im2 b of asecond modification. In the second modification, the description will bemade on the assumption that four rectangular regions Rs1 to Rs4 having apredetermined size are determined in advance as the image additionregions Rs which are positioned at four corners of the original imageIm1. The generation unit 13 of the first information processing device10 generates an image, as the position specifying image Im2 b, in whichfour arrows (or solid lines) representing directions from therepresentative points of these four rectangular regions Rs1 to Rs4 inthese four rectangular regions Rs1 to Rs4 to the representative point ofthe write region Rn are disposed.

For example, the representative points of the four rectangular regionsRs1 to Rs4 are set as the vertexes P1 to P4 of the corners of therespective images. In a case where the representative point of the writeregion Rn is set as the center point Pc of the write region Rn, thegeneration unit 13 generates, as illustrated in FIG. 10, an image as theposition specifying image Im2 b in which: the arrow indicating adirection from the left upper vertex P1 of the image to the center pointPc of the write region Rn is disposed in the rectangular region Rs1which is positioned in the left upper portion of the image; the arrowindicating a direction from the right upper vertex P2 of the image tothe center point Pc of the write region Rn is disposed in therectangular region Rs2 which is positioned in the right upper portion ofthe image; the arrow indicating a direction from the left lower vertexP3 of the image to the center point Pc of the write region Rn isdisposed in the rectangular region Rs3 which is positioned in the leftlower portion of the image; and the arrow indicating a direction fromthe right lower vertex P4 of the image to the center point Pc of thewrite region Rn is disposed in the rectangular region Rs4 which ispositioned in the right lower portion of the image.

In a case of the second modification, the specification unit 22 of thesecond information processing device 20 first estimates the inclinationsof the arrows (or the solid lines) disposed in the respectiverectangular region Rs1 to Rs4 using a known method such as the Houghtransform or the least square method with respect to the fourrectangular regions Rs1 to Rs4 of the position specifying image Im2 bincluded in the processed image Im4. Then, the specification unit 22expresses the four arrows (or the solid lines) in an expression ofa_(i)x+b_(i)y+c=0 (where, i=1, 2, 3, and 4; a²+b²=1) and obtains apoint, as the representative point (for example, the center point Pc) ofthe write region Rn, at which the square sum of distances to the fourarrows (or the solid lines) is minimized. The point may be obtained as apoint (x, y) derived as a solution of the following linear Equation (2).In this case, parameter N represents the number of arrows (or the solidlines).

$\begin{matrix}{{\sum\limits_{i = 0}^{N - 1}{\begin{pmatrix}a_{i}^{2} & {a_{i}b_{i}} \\{a_{i}b_{i}} & b_{i}^{2}\end{pmatrix}\begin{pmatrix}x \\y\end{pmatrix}}} = {\sum\limits_{i = 0}^{N - 1}{c_{i}\begin{pmatrix}a_{i} \\b_{i}\end{pmatrix}}}} & (2)\end{matrix}$

Using the above methods, the specification unit 22 obtains thecoordinate values of the representative point (for example, the centerpoint Pc) of the write region Rn. Therefore, the position of the writeregion Rn in the processed image Im4 can be specified.

Further, on the assumption that the four rectangular regions Rs1 to Rs4are determined as the image addition regions Rs in advance, the positionspecifying image Im2 b illustrated in FIG. 10 disposes the arrowsindicating the directions from the representative points P1 to P4 of therespective rectangular regions Rs1 to Rs4 to the center point Pc of thewrite region Rn in the four rectangular regions Rs1 to Rs4. However, theposition specifying image Im2 b of the second modification may be animage in which the arrows (or the solid lines) are disposed in at leasttwo rectangular regions. For example, in a case where the image with thearrows (or the solid lines) in the two rectangular region is used as theposition specifying image Im2 b, an intersection of the two arrows (orthe solid lines) included in the position specifying image Im2 b isobtained as the representative point of the write region Rn. Therefore,the position of the write region Rn can be specified. In this case,similarly to the position specifying image Im2 b illustrated in FIG. 10,the arrows (or the solid lines) are disposed in the four rectangularregions Rs1 to Rs4, so that the redundant pieces of information forspecifying the position of the write region Rn can be obtained. Forexample, even when one (or two) of the four arrows (or the solid lines)is difficult to be appropriately read due to the overlapping with apre-existing entry, the position of the write region Rn may be correctlyspecified using the other arrows (or the solid lines).

In addition, in the position specifying image Im2 b of the secondmodification, an additional small region may be provided besides thefour rectangular regions Rs1 to Rs4 in which the arrows (or the solidlines) are disposed as described above. In the additional small region,information representing the size of the write region Rn may bedisposed.

Third Modification

FIG. 11 is a diagram illustrating a position specifying image Im2 c of athird modification. On the assumption that a predetermined size of therectangular region disposed in a corner portion (for example, the leftupper corner portion of the image) of the original image Im1 isdetermined as the image addition region Rs in advance, the positionspecifying image Im2 c of the third modification includes the fourarrows (or the solid lines) illustrated in the second modification whichare integrated in one image addition region Rs.

For example, in a case where the region of the left upper corner portionof the image is set to as the image addition region Rs, the generationunit 13 of the first information processing device 10 generates animage, as the position specifying image Im2 c in which: the arrowindicating a direction from the left upper vertex P1 of the image to thecenter point Pc of the write region Rn is disposed in the image additionregion Rs with the vertex P1 as the base point; the arrow indicating adirection from the right upper vertex P2 of the image to the centerpoint Pc of the write region Rn is disposed in the image addition regionRs with a right upper vertex P2′ of the image addition region Rs as thestarting point; the arrow indicating a direction from the left lowervertex P3 of the image to the center point Pc of the write region Rn isdisposed in the image addition region Rs with a left lower vertex P3′ ofthe image addition region Rs as the starting point; and the arrowindicating a direction from the right lower vertex P4 of the image tothe center point Pc of the write region Rn is disposed in the imageaddition region Rs with a right lower vertex P4′ of the image additionregion Rs as the starting point.

In a case of the third modification, the specification unit 22 of thesecond information processing device 20 estimates the inclinations ofthe four arrows (or the solid lines) disposed in the image additionregion Rs using a known method such as the Hough transform or the leastsquare method with respect to the image addition region Rs of theposition specifying image Im2 c included in the processed image Im4.Then, the coordinate values of the representative point (for example,the center point Pc) of the write region Rn is obtained by the similarmethod to the second modification. Therefore, the position of the writeregion Rn in the processed image Im4 can be specified.

Further, the position specifying image Im2 c illustrated in FIG. 11 isan image with the four arrows (or the solid lines) disposed in the imageaddition region Rs, but may be an image which includes at least twoarrows (or the solid lines) similarly to the second modification. Inthis case, similarly to the position specifying image Im2 c illustratedin FIG. 11, the four arrows (or the solid lines) are disposed in theimage addition region Rs, so that the redundant pieces of informationfor specifying the position of the write region Rn can be obtainedsimilarly to the second modification. In addition, the positionspecifying image Im2 c illustrated in FIG. 11 has been provided as anexample in which the left upper corner portion of the image is set asthe image addition region Rs. However, another corner portion of theimage may be set as the image addition region Rs, and a plurality ofarrows (or the solid lines) may be integrated in the image additionregion Rs. Furthermore, a plurality of corner portions of the image eachmay be provided with the image addition region Rs, and the plurality ofimage addition regions Rs each may be provided with the plurality ofarrows (or the solid lines) integrated therein. In this case, it ispossible to further increase redundancy in the information forspecifying the positions of the write regions Rn.

In addition, in the position specifying image Im2 c of the thirdmodification, an additional small region may be provided besides theimage addition region Rs in which the arrows (or the solid lines) areinterposed as described above. In the additional small region,information representing the size of the write region Rn may bedisposed.

Fourth Modification

FIG. 12 is a diagram illustrating a position specifying image Im2 d of afourth modification. In the fourth modification, similarly to the secondmodification, the description will be made on the assumption that fourrectangular regions Rs1 to Rs4 having a predetermined size aredetermined in advance as the image addition regions Rs which arepositioned at four corners of the original image Im1. In addition, inthe fourth modification, two vertexes (the left upper vertex Pa and theright lower vertex Pb of the write region Rn in the example of FIG. 12)pairing the opposing corners of the write region Rn are set as therepresentative points of the write region Rn.

In a case of the fourth modification, the generation unit 13 of thefirst information processing device 10 generates, for example, asillustrated in FIG. 12, an image as the position specifying image Im2 din which: the arrow indicating a direction from the left upper vertex P1of the image to the left upper vertex Pa of the write region Rn isdisposed in the rectangular region Rs1 which is positioned in the leftupper portion of the image; the arrow indicating a direction from theright upper vertex P2 of the image to the right lower vertex Pb of thewrite region Rn is disposed in the rectangular region Rs2 which ispositioned in the right upper portion of the image; the arrow indicatinga direction from the left lower vertex P3 of the image to the left uppervertex Pa of the write region Rn is disposed in the rectangular regionRs3 which is positioned in the left lower portion of the image; and thearrow indicating a direction from the right lower vertex P4 of the imageto the right lower vertex Pb of the write region Rn is disposed in therectangular region Rs4 which is positioned in the right lower portion ofthe image.

In the case of the fourth modification, the specification unit 22 of thesecond information processing device 20 first estimates the inclinationsof the arrows (or the solid lines) which are disposed in the fourrectangular regions Rs1 to Rs4 of the position specifying image Im2 dincluded in the processed image Im4 using the similar method to thesecond modification. Then, the specification unit 22 obtains theintersection between the arrow (or the solid line) disposed in therectangular region Rs1 and the arrow (or the solid line) disposed in therectangular region Rs3 as the left upper vertex Pa of the write regionRn, and obtains the intersection between the arrow (or the solid line)disposed in the rectangular region Rs2 and the arrow (or the solid line)disposed in the rectangular region Rs4 as the right lower vertex Pb ofthe write region Rn, thereby being able specifying the position of thewrite region Rn.

Further, in the position specifying image Im2 d of the fourthmodification, an additional small region may be provided besides thefour rectangular regions Rs1 to Rs4 in which the arrows (or the solidlines) are disposed as described above. In the additional small region,information representing the size of the write region Rn may bedisposed. Therefore, even though a part of the four arrows (or the solidlines) of the position specifying image Im2 d is missed due to a printfailure, a read failure, or the like, the size of the write region Rncan be recognized, and thus the position of the write region Rn can becorrectly specified.

Fifth Modification

FIG. 13 is a diagram illustrating a position specifying image Im2 e of afifth modification. Similarly to the third modification, on theassumption that a predetermined size of the rectangular regionpositioned in one corner portion (for example, the left upper cornerportion of the image) of the original image Im1 is determined as theimage addition region Rs in advance, the position specifying image Im2 eof the fifth modification is an image in which the four arrows (or thesolid lines) illustrated in the fourth modification are integrated inone image addition region Rs.

For example, in a case where the region of the left upper corner portionof the image is set as the image addition region Rs, the generation unit13 of the first information processing device 10 generates an image asthe position specifying image Im2 e in which: the arrow indicating adirection from the left upper vertex P1 of the image to the left uppervertex Pa of the write region Rn is disposed in the image additionregion Rs with the vertex P1 as the base point; the arrow indicating adirection from the right upper vertex P2 of the image to the right lowervertex Pb of the write region Rn is disposed in the image additionregion Rs with the right upper vertex P2′ of the image addition regionRs as the starting point; the arrow indicating a direction from the leftlower vertex P3 of the image to the left upper vertex Pa of the writeregion Rn is disposed in the image addition region Rs with the leftlower vertex P3′ of the image addition region Rs as the starting point;and the arrow indicating a direction from the right lower vertex P4 ofthe image to the right lower vertex Pb of the write region Rn isdisposed in the image addition region Rs with the right lower vertex P4′of the image addition region Rs as the starting point.

In a case of the fifth modification, the specification unit 22 of thesecond information processing device 20 estimates the inclinations ofthe four arrows (or the solid lines) of the position specifying imageIm2 e included in the processed image Im4 similarly to the thirdmodification, and obtains the coordinate values of the two vertexes (forexample, the left upper vertex Pa and the right lower vertex Pb) pairingthe opposing corners of the write region Rn using the similar method tothe fourth modification. Therefore, the position of the write region Rnin the processed image Im4 can be specified. Further, the positionspecifying image Im2 e illustrated in FIG. 13 has been provided as anexample in which the left upper corner portion of the image as the imageaddition region Rs. However, another corner portion of the image may beset as the image addition region Rs, and a plurality of arrows (or thesolid lines) may be integrated and disposed in the image addition regionRs. Furthermore, a plurality of corner portions of the image each may beprovided with the image addition region Rs, and the plurality of imageaddition regions Rs each may be provided with a plurality of arrows (orthe solid lines) integrated and disposed therein. In this case, it ispossible to increase redundancy in the information for specifying thepositions of the write regions Rn.

In addition, in the position specifying image Im2 e of the fifthmodification, an additional small region may be provided besides theimage addition region Rs in which the arrows (or the solid lines) areintegrated and disposed therein as described above. In the additionalsmall region, information representing the size of the write region Rnmay be disposed.

Sixth Modification

FIG. 14 is a diagram illustrating a position specifying image Im2 f of asixth modifications. The sixth modification is an example in a casewhere the detection unit 12 of the first information processing device10 detects the two write regions Rn1 and Rn2 from the original imageIm1. The position specifying image Im2 f of the sixth modification is animage to be used for specifying the positions of the two write regionsRn1 and Rn2; it has the similar pattern to, for example, the positionspecifying image Im2 c of the third modification.

For example, the representative point of the write region Rn1 is set asthe center point Pc1 of the write region Rn1, and the representativepoint of the write region Rn2 is set as the center point Pc2 of thewrite region Rn2. In a case where the region of the left upper cornerportion of the image is set as the image addition region Rs, thegeneration unit 13 of the first information processing device 10generates an image as the position specifying image Im2 f in which: thearrow indicating a direction from the left upper vertex P1 of the imageto the center point Pct of the write region Rn1 is disposed in the imageaddition region Rs with the vertex P1 as the base point; the arrowindicating a direction from the right upper vertex P2 of the image tothe center point Pc1 of the write region Rn1 is disposed in the imageaddition region Rs with the right upper vertex P2′ of the image additionregion Rs as the starting point; the arrow indicating a direction fromthe left lower vertex P3 of the image to the center point Pc2 of thewrite region Rn2 is disposed in the image addition region Rs with theleft lower vertex P3′ of the image addition region Rs as the startingpoint; and the arrow indicating a direction from the right lower vertexP4 of the image to the center point Pc2 of the write region Rn2 isdisposed in the image addition region Rs with the right lower vertex P4′of the image addition region Rs as the starting point.

In a case of the sixth modification, the specification unit 22 of thesecond information processing device 20 estimates the inclinations ofthe four arrows (or the solid lines) of the position specifying imageIm2 f included in the processed image Im4, similarly to the thirdmodification. Then, the specification unit 22 obtains, as therepresentative point of the write region Rn1, the intersection betweenthe arrow (or the solid lines) with the left upper vertex P1 of theimage addition region Rs as the base point and the arrow (or the solidlines) with the right upper vertex P2′ of the image addition region Rsas the base point, so that the position of the write region Rn1 in theprocessed image Im4 can be specified. In addition, the specificationunit 22 obtains, as the representative point of the write region Rn2,the intersection between the arrow (or the solid lines) with the leftlower vertex P3′ of the image addition region Rs as the base point andthe arrow (or the solid lines) with the right lower vertex P4′ of theimage addition region Rs as the base point, so that the position of thewrite region Rn2 in the processed image Im4 can be specified.

Further, the position specifying image Im2 f illustrated in FIG. 14 hasbeen provided as an example in which the left upper corner portion ofthe image is set as the image addition region Rs. However, anothercorner portion of the image may be set as the image addition region Rs,and the four arrows (or the solid lines) may be integrated and disposedin the image addition region Rs. Furthermore, a plurality of cornerportions of the image each may be provided with the image additionregion Rs, and the plurality of image addition regions Rs each may beprovided with the four arrows (or the solid lines) integrated anddisposed therein. In this case, it is possible to increase redundancy inthe information for specifying the positions of the write regions Rn,and it is also possible to cope with the case where three write regionsRn or more are detected.

In addition, the position specifying image Im2 f illustrated in FIG. 14has been described to be able to specify the positions of the two writeregions Rn1 and Rn2, using the similar pattern to the positionspecifying image Im2 c of the third modification, but the invention isnot limited thereto. For example, an image may be formed so as tospecify the positions of the two write regions Rn1 and Rn2 using thesimilar patterns to the first modification and the second modification.

Seventh Modification

FIG. 15 is a diagram illustrating a position specifying image Im2 g of aseventh modification. Similarly to the fifth modification, the positionspecifying image Im2 g of the seventh modification is on the assumptionthat the four arrows (or the solid lines) for obtaining the two vertexesPa and Pb pairing the opposing corners of the write region Rn areintegrated and disposed in one image addition region Rs, and the lengthsof the respective arrows (or the solid lines) are set in proportion todistances to the vertexes Pa and Pb.

For example, in a case where the region of the left upper corner portionof the image is set as the image addition region Rs, the generation unit13 of the first information processing device 10 generates an image asthe position specifying image Im2 g in which the following arrows aredisposed in the image addition region Rs using the similar method to thefifth modification: the arrow which indicates a direction from the leftupper vertex P1 of the image to the left upper vertex Pa of the writeregion Rn, having a length in proportion to the distance between P1 andPa; the arrow which indicates a direction from the right upper vertex P2of the image to the right lower vertex Pb of the write region Rn, havinga length in proportion to the distance between P2 and Pb; the arrowwhich indicates a direction from the left lower vertex P3 of the imageto the left upper vertex Pa of the write region Rn, having a length inproportion to the distance between P3 and Pa; and the arrow whichindicates a direction from the right lower vertex P4 of the image to theright lower vertex Pb of the write region Rn, having a length inproportion to a distance between P4 and Pb.

In a case of the seventh modification, the specification unit 22 of thesecond information processing device 20 obtains the coordinate values ofthe two vertexes (for example, the left upper vertex Pa and the rightlower vertex Pb) pairing the opposing corners of the write region Rnusing the similar method to the fifth modification. Therefore, theposition of the write region Rn in the processed image Im4 can bespecified. Furthermore, in a case of the seventh modification, even whenone of the two arrows for obtaining a vertex of the write region Rn isnot exactly acquired, the coordinate values of the vertex of the writeregion Rn can be obtained based on the length of the other arrow.Therefore, the position of the write region Rn in the processed imageIm4 can be specified.

Further, the position specifying image Im2 g illustrated in FIG. 15 hasbeen provided as an example in which the left upper corner portion ofthe image is set as the image addition region Rs. However, anothercorner portion of the image may be set as the image addition region Rs,and a plurality of arrows (or the solid lines) may be integrated anddisposed in the image addition region Rs. Furthermore, a plurality ofcorner portions of the image each may be provided with the imageaddition region Rs, and the plurality of image addition regions Rs eachmay be provided with the plurality of arrows (or the solid lines)integrated and disposed therein. In this case, it is possible toincrease redundancy in the information for specifying the positions ofthe write regions Rn.

In addition, in the position specifying image Im2 g of the seventhmodification, an additional small region may be provided besides theimage addition region Rs in which the arrows (or the solid lines) areintegrated and disposed therein as described above. In the additionalsmall region, information representing the size of the write region Rnmay be disposed.

Hardware Configuration of Information Processing Device

The above-mentioned respective functions of the first informationprocessing device 10 and the above-mentioned respective functions of thesecond information processing device 20 according to the embodiment maybe implemented by causing, for example, the first information processingdevice 10 and the second information processing device 20 to execute apredetermined program. In this case, for example, as illustrated in FIG.16, the first information processing device 10 and the secondinformation processing device 20 have a hardware configuration using atypical computer, including a controller such as a CPU (CentralProcessing Unit) 101, a storage device such as a ROM (Read Only Memory)102 and a RAM (Random Access Memory) 103, a communication I/F 104 whichis connected to a network for communication, a bus 105 which isconnected to the respective components, and the like.

The program executed in the first information processing device 10 andthe second information processing device 20 may be recorded in acomputer-readable recording medium such as a CD-ROM (Compact Disk ReadOnly Memory), a flexible disk (FD), a CD-R (Compact Disk Recordable),and a DVD (Digital Versatile Disc) in an installable or executable fileformat in order to be provided as a computer program product.

In addition, the program executed in the first information processingdevice 10 and the second information processing device 20 may be storedin a computer connected to a network such as the Internet, and thenprovided by downloading the program through the network. In addition,the program executed in the first information processing device 10 andthe second information processing device 20 may be supplied ordistributed through the network such as the Internet.

In addition, the program executed in the first information processingdevice 10 and the second information processing device 20 may beembedded in the ROM 102 for supply or the like in advance.

The program executed in the first information processing device 10 isconfigured in a module type including the respective processing units(the receiving unit 11, the detection unit 12, the generation unit 13,and the output unit 14) of the first information processing device 10.Further, as practical hardware, for example, a CPU 101 (a processor)reads the program from the above-mentioned recording medium to load therespective processing units described above on the main storage device,and thus the respective processing units described above are generatedon the main storage device. Further, the first information processingdevice 10 may be configured such that some or all of the processingunits described above may be realized using a dedicated hardware packagesuch as an ASIC (Application Specific Integrated Circuit) or an FPGA(Field-Programmable Gate Array).

The program executed in the second information processing device 20 isconfigured in a module type including the respective processing units(the receiving unit 21, the specification unit 22, the recognition unit23, and the output unit 24) of the second information processing device20. Further, as practical hardware, for example, the CPU 101 (aprocessor) reads the program from the above-mentioned recording mediumto load the respective processing units described above on the mainstorage device, and thus the respective processing units described aboveare generated on the main storage device. Further, the secondinformation processing device 20 may be configured such that some or allof the processing units described above may be realized using adedicated hardware package such as the ASIC or the FPGA.

Further, in the form processing system according to the embodiment, thefirst information processing device 10 and the second informationprocessing device 20 are realized in individual devices, but thefunction of the first information processing device 10 and the functionof the second information processing device 20 may be realized as twofunctions in a single information processing device. In this case, theinformation processing device has a first operation mode in which thedevice operates as the first information processing device 10, and asecond operation mode in which the device operates as the secondinformation processing device 20. These operation modes are switched torealize the two functions of the first information processing device 10and the second information processing device 20.

In addition, the form processing system according to the embodiment hasbeen described such that: the write position to be written with theprocess number is detected from the original image Im1 which is imagedata acquired by optically reading the ledger sheet LS1; the positionspecifying image Im2 used for specifying the write position isgenerated; and the process number is recognized based on the positionspecifying image Im2 from the processed image Im4 which is image dataacquired by optically reading the ledger sheet LS2 obtained by printingthe process number and the position specifying image Im2 on the ledgersheet LS1. However, the position specifying image Im2 and the image ofthe process number may be synthesized in the original image Im1 togenerate the processed image Im4, and the process number may berecognized from the processed image Im4 based on the position specifyingimage Im2. In other words, after the position specifying image Im2 andthe image of the process number are printed once, the printed image dataitself may be handled without optically reading the printed images.

In addition, the embodiments described above has been described inconnection to exemplary applications to the form processing system, butthe applicable examples are not limited thereto. Further, the use ofwriting the additional information on a document with entries alreadywritten therein may be widely applied to any system and devices.

While certain embodiments have been described, these embodiments havebeen presented by way of example only, and are not intended to limit thescope of the inventions. Indeed, the novel embodiments described hereinmay be embodied in a variety of other forms; furthermore, variousomissions, substitutions and changes in the form of the embodimentsdescribed herein may be made without departing from the spirit of theinventions. The accompanying claims and their equivalents are intendedto cover such forms or modifications as would fall within the scope andspirit of the inventions.

What is claimed is:
 1. An information processing device comprising: areceiving unit configured to receive an original image; a detection unitconfigured to detect a write region in which additional information isto be written, from the original image; a generation unit configured togenerate a position specifying image for specifying a position of thewrite region in the original image, the position specifying image beingto be added to a predetermined region in the original image; and anoutput unit configured to output the position specifying image.
 2. Thedevice according to claim 1, wherein the position specifying imagerepresents coordinate values of the write region in the original image.3. The device according to claim 1, wherein the position specifyingimage includes an image that represents a horizontal position or avertical position of the write region and that is distinguished fromimages at other positions in the predetermined region of the originalimage.
 4. The device according to claim 1, wherein the positionspecifying image includes an image that represents a direction from arepresentative point in the predetermined region of the original imagetoward a representative point of the write region.
 5. An informationprocessing device comprising: a receiving unit configured to receive aprocessed image in which the position specifying image output from theinformation processing device according to claim 1 is added to thepredetermined region of the original image, and the additionalinformation is written in the write region detected by the informationprocessing device according to claim 1; a specification unit configuredto specify the write region in the processed image based on the positionspecifying image; and a recognition unit configured to recognize theadditional information written in the specified write region.
 6. Aninformation processing method comprising: receiving an original image;detecting a write region in which additional information is to bewritten, from the original image; generating a position specifying imagefor specifying a position of the write region in the original image, theposition specifying image being to be added to a predetermined region inthe original image; and outputting the position specifying image.
 7. Acomputer program product comprising a computer-readable mediumcontaining a program executed by a computer, the program causing thecomputer to execute: receiving an original image; detecting a writeregion in which additional information is to be written, from theoriginal image; generating a position specifying image for specifying aposition of the write region in the original image, the positionspecifying image being to be added to a predetermined region in theoriginal image; and outputting the position specifying image.